Information processing device and non-transitory computer readable medium

ABSTRACT

An information processing device includes: a receiving interface that receives a layout of at least one figure based on an instruction of a user, the at least one figure representing a meaning of at least part of target data based on a meaning obtained from the target data; and a display controller that displays the at least one figure on a display according to the layout received by the receiving interface.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 fromJapanese Patent Application No. 2018-017690 filed on Feb. 2, 2018.

BACKGROUND Technical Field

The present invention relates to an information processing device and anon-transitory computer readable medium.

SUMMARY

According to an aspect of the invention, there is provided aninformation processing device including: a receiving interface thatreceives a layout of at least one figure based on an instruction of auser, the at least one figure representing a meaning of at least part oftarget data based on a meaning obtained from the target data; and adisplay controller that displays the at least one figure on a displayaccording to the layout received by the receiving interface.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments of the present invention will be described indetail based on the following figures, wherein:

FIG. 1 is a schematic configuration diagram of an information processingdevice according to this exemplary embodiment;

FIG. 2 is a view illustrating a first display example of a semanticfigure;

FIG. 3 is a view illustrating a second display example of a semanticfigure;

FIG. 4 is a view illustrating a first display example of a semanticfigure that is displayed for each of categories;

FIG. 5 is a view illustrating a second display example of a semanticfigure that is displayed for each of categories;

FIG. 6 is a view illustrating a third display example of a semanticfigure that is displayed for each of categories;

FIG. 7 is a view illustrating a display example of explanation ofsemantic figures;

FIG. 8 is a view illustrating a display example of an errornotification;

FIG. 9 is a view illustrating an example in which term expressions areeach displayed at a position according to the meaning of each term;

FIG. 10 is an example of a screen for setting display positions of termexpressions;

FIG. 11 is a view illustrating a display example in which termexpressions are displayed at set display positions;

FIG. 12 is a first figure illustrating a display example in which termexpressions corresponding to terms with a similar meaning are displayedin proximity;

FIG. 13 is a second figure illustrating a display example in which termexpressions corresponding to terms with a similar meaning are displayedin proximity;

FIG. 14 is a view illustrating a display example of multiple imagesrepresenting target data;

FIGS. 15A to 15C are views illustrating examples of a screen for settinglayout;

FIG. 16 is a view illustrating the manner in which a frame is deleted bya sliding operation;

FIG. 17 is a view illustrating a layout after the sliding operation;

FIG. 18 is a view illustrating the manner in which frames are combinedby a pinch-in operation;

FIG. 19 is a view illustrating a layout after the pinch-in operation;

FIGS. 20A and 20B are views illustrating the manner in which a frame isdivided by a pinch-out operation;

FIGS. 21A and 21B are views illustrating the manner in which a frame isdivided by a sliding operation; and

FIGS. 22A and 22B provide a second figure illustrating the manner inwhich a frame is divided by a sliding operation.

DETAILED DESCRIPTION First Exemplary Embodiment

FIG. 1 is a schematic configuration diagram of an information processingdevice 10 according to a first exemplary embodiment. Although examplesof the information processing device 10 include a mobile terminal suchas a personal computer and a smartphone, or a server, the informationprocessing device 10 may be any device as long as the device canimplement the following functions.

The memory 12 is configurated to include, for instance, a ROM, a RAM, ora hard disk. The memory 12 stores information processing programs foroperating the components of the information processing device 10.Furthermore, as illustrated in FIG. 1, target data 14 is stored in thememory 12.

The target data 14 is data to be processed by the information processingdevice 10, and includes a document such as a web page or an electronicdocument, dynamic image data, and voice data. The target data 14 may beobtained from a device other than the information processing device 10via a communicator (not illustrated), or may be generated by theinformation processing device 10.

An input interface 16 is configurated to include, for instance, a touchpanel, a keyboard, a voice input, and/or a mouse. Also, the inputinterface 16 may be is configurated to include an interface thatreceives a non-contact operation (gesture) utilizing voice, a camera, ora sensor. The input interface 16 is used to input an instruction of auser of the information processing device 10.

The display 18 is configurated to include, for instance, a liquidcrystal panel. On the display 18, various screens are displayed, andparticularly, a result of processing by the later-described controller20 is displayed.

It is to be noted that when the information processing device 10 is aserver, the information processing device 10 may not include the inputinterface 16 and the display 18. In this case, a touch panel, akeyboard, and a mouse of a user terminal utilized by a user who hasgained access to the server correspond to the input interface 16, and aliquid crystal panel or the like of the user terminal corresponds to thedisplay 18.

The controller 20 is configurated to include, for instance, a CPU or amicro controller. The controller 20 controls the components of theinformation processing device 10 in accordance with an informationprocessing program stored in the memory 12. As illustrated in FIG. 1,the controller 20 also functions as an analyzer 22, a counter 24, asemantic figure generator 26, a layout setting part 28, and a displaycontroller 30.

The analyzer 22 obtains the meaning (contents) of the target data 14 byanalyzing the target data 14. Specifically, the analyzer 22 obtains themeaning of the target data 14 by performing natural language processingon a character string extracted from the target data 14.

Regarding the extraction of a character string from the target data 14,when the target data 14 is an electronic document, a character stringcan be extracted, for instance, by performing character recognitionprocessing on the electronic document. When the target data 14 isdynamic image data or voice data, a character string can be extracted byconverting the voice included in the dynamic image data or the voicedata into text data.

The natural language processing is processing including morphologicalanalysis, syntax analysis, semantic analysis, and context analysis.

The morphological analysis is processing that divides a character stringinto multiple morphemes (each of which is a minimum unit having ameaning in a language) in a sequence based on a grammar of a targetlanguage and information, such as word classes of single words, called adictionary, and determines the word class of each of the morphemes.

The syntax analysis is processing that identifies a syntacticalrelationship such as a relationship between the multiple morphemes (forinstance, a relationship between a modifier and a modifiee), anddetermines a positional relationship (such as a modificationrelationship) between the multiple morphemes. Multiple patterns ofsyntax tree (a tree structure having the morphemes as nodes) are formedby the syntax analysis.

The semantic analysis is processing that considers the meaning of eachof the morphemes, and determines a correct connection between themultiple morphemes based on the meaning of each morpheme. A semanticallycorrect syntax tree is selected from the multiple patterns of syntaxtree by the semantic analysis.

The context analysis is processing that performs the syntax analysis andthe semantic analysis on a sentence made up of one or more morphemes.For instance, the contents of each demonstrative pronoun appears in asecond sentence are grasped based on the contents of a first sentence bythe context analysis.

The analyzer 22 may identify particularly one or more priority parts ofthe target data 14 by performing natural language processing on thetarget data 14. In particular, the analyzer 22 may identify not only acharacter string which explicitly appears in the target data 14, butalso contents including contents estimated from the contents of thecharacter string, as a priority part.

Also, the analyzer 22 may analyze the meaning of the entire target data14, and may generate a summary character string that indicates an entiresummary of the target data 14. The summary is the meaning (contents)which is particularly desired to be represented by the target data 14,and may overlap with the priority part of the target data 14. However,the summary character string may not be part of the character stringextracted from the target data 14.

Alternatively, the analyzer 22 may divide the target data 14 intomultiple categories based on the meaning of the target data 14. Forinstance, the target data 14 may be divided into four categories: thepurpose, the problem, the solution, and the homework by the next time.

Alternatively, the analyzer 22 may identify a priority part for each ofthe categories. Furthermore, the analyzer 22 may generate a summarycharacter string for each of the categories.

It is to be noted that how the target data 14 is divided may be set by auser.

The counter 24 counts the number of times of appearance of each ofmultiple terms which appear in the target data 14. Here, the “term” is aconcept that includes a single word which is a minimum constituent unitin a sentence, and a string or a phrase containing multiple singlewords.

The semantic figure generator 26 generates a semantic figure thatrepresents the meaning of at least part of the target data 14, based onthe meaning of the target data 14 obtained by the analyzer 22. Examplesof a semantic figure includes a figure that allows a user to understanda relationship between the terms included in part of the target data 14based on which a semantic figure is generated, for instance, arelationship between the subject (who), the predicate (does), and theobject (what). Each semantic figure includes one or more components. Thecomponents are a graphic, a photograph, or a character. For instance, asemantic figure is configurated to combine a component indicating thesubject, a component indicating the predicate, and a componentindicating the object. The details of the semantic figure will bedescribed later.

The semantic figure generator 26 generates a semantic figure thatrepresents, for instance, the meaning of a priority part, which isdetermined to have priority, of the target data 14. The determination ofa priority part is made, for instance, based on a result of analysis bythe analyzer 22 or a result of count by the counter 24. Alternatively,the semantic figure generator 26 may generate a semantic figure thatrepresents a summary character string generated by the analyzer 22.

Alternatively, the semantic figure generator 26 may generate multiplesemantic figures that represent the meaning of multiple parts of thetarget data 14.

The layout setting part 28 sets a (display) layout for a semantic figuregenerated by the semantic figure generator 26. The layout is a conceptthat includes, for instance, a position the display 18, at which asemantic figure is displayed, and a size of the semantic figure. Thelayout setting part 28 sets a layout for a semantic figure based on aninstruction from a user.

The display controller 30 performs processing for displaying variousscreens on the display 18. The display controller 30 displays,particularly a semantic figure generated by the semantic figuregenerator 26 on the display 18.

Hereinafter, the processing performed by the semantic figure generator26 and the display controller 30 in the first exemplary embodiment willbe described in detail.

FIG. 2 illustrates a display example of a semantic figure 40 generatedby the semantic figure generator 26. In FIG. 2, a partial characterstring, that is, “makes electronic payment with a smartphone, at aconvenience store, at 17:00” is determined to be a priority part of acharacter string extracted from the target data 14, and the semanticfigure 40 representing the priority part is illustrated.

As described above, the semantic figure 40 includes multiple components42 to 50. The above-mentioned priority part is represented by thesemultiple components 42 to 50. For instance, the component 42 is agraphic that directly indicates a “smartphone”. In addition, thecomponent 44 is a graphic that indicates money, the component 46 is agraphic that indicates a cash register, and “electronic payment” isrepresented by the component 44 and the component 46. In order toillustrate electronic payment by a smartphone in a more understandablemanner, the semantic figure 40 includes the component 48 that is anarrow graphic pointing from the component 42 (smartphone) to thecomponent 46 (cash register).

The semantic figure 40 may include a component that represents a termnot contained in a partial character string (“makes electronic paymentwith a smartphone, at a convenience store, at 17:00” in the example),based on which the semantic figure 40 is generated, among a characterstring extracted from the target data 14. In the example of FIG. 2, thecomponent 50 representing a “male” which is a term not contained in thepartial character string is included in the semantic figure 40. It isrepresented by the component 50 that electronic payment is made by amale.

In the partial character string based on which the semantic figure 40 isgenerated, it is not explicitly represented that electronic payment ismade by a male. However, in natural language processing performed oncharacter strings including a character string other than the partialcharacter string, it may be determined that electronic payment is madeby a male. In such a case, in order to illustrate that electronicpayment is made by a male in an understandable manner, the semanticfigure generator 26 generates a semantic figure 40 including thecomponent 50 representing a male.

Also, as described above, a component included in the semantic figure 40is not limited to a graphic, but may be a photograph or a character. Forinstance, in the example of FIG. 2, the component 42 is represented, inwhich a smartphone is a graphic. However, when a specific model ofsmartphone is desired to be represented, for instance, the specificmodel of smartphone has a priority in the target data 14, the semanticfigure generator 26 may include a photograph of the specific model ofsmartphone in the semantic figure 40 instead of the component 42.

Alternatively, the semantic figure 40 may include a component which is acharacter. For instance, a semantic figure 40′ illustrated in FIG. 3includes a component 52 which is the character of “convenience store” asa term contained in a partial character string based on which thesemantic figure 40′ is generated, as well as a component 54 which is thecharacter of “17:00” as a term contained in the partial characterstring. Also here, the semantic figure 40′ may include a component of acharacter indicating a term not contained in the partial characterstring.

Alternatively, the display controller 30 may determine a display mode ofa component included in the semantic figure 40 based on a level ofpriority of the term represented by the component in the target data 14.For instance, in the semantic figure 40′ illustrating in FIG. 3, whenthe “convenience store” is determined to have more priority from the“17:00” in the meaning of target data 14 based on the results ofprocessing performed by the analyzer 22 and the counter 24, thecomponent 52 which is the character of “convenience store” is displayedlarger than the component 54 which is the character of “17:00”. It goeswithout saying that the level of priority of a component may berepresented in a display mode using a parameter other than the size. Forinstance, when a component is a character, the level of priority of thecomponent may be represented by the font of the component.

Also, the display controller 30 may display graphics, photographs, andcharacters not included in the semantic figure 40 (hereinafter referredto as “non-components”) along with the semantic figure 40. In theexample of FIG. 3, non-components 60 to 64 are illustrated. Thenon-components 60 to 64 represent, for instance, a part having a levelof priority lower than the level of priority of a part of the targetdata 14, based on which the semantic figure 40 is generated.

The non-components 60 to 64 are displayed in a display mode which allowsthe non-components 60 to 64 to be distinguished from the components 42to 54 included in the semantic figure 40. For instance, the components42 to 54 included in the semantic figure 40 are disposed close to eachother, and the non-components 60 to 64 are displayed at positions spacedaway from the components 42 to 54. Alternatively, the components 42 to54 may be displayed in a size larger than the non-components 60 to 64.Also, the components 42 to 54 and the non-components 60 to 64 may bedisplayed in different colors, or when each of the components is acharacter, the components 42 to 54 and the non-components 60 to 64 maybe displayed in different fonts or with different thicknesses.

As described above, the semantic figure generator 26 may generatemultiple semantic figures that represent the meaning of multiple partsof the target data 14. In particular, the semantic figure generator 26may generate for each of the categories in the meaning of the targetdata 14. The display controller 30 may display multiple semantic figurescorresponding to the categories.

FIG. 4 illustrates a first display example of multiple semantic figurescorresponding to multiple categories. In the example of FIG. 4, theanalyzer 22 divides the target data 14 into four categories: thepurpose, the problem, the solution, and the homework by the next time,the semantic figure generator 26 generates a semantic figure 40acorresponding to the purpose, a semantic figure 40b corresponding to theproblem, a semantic figure 40c corresponding to the solution, and asemantic figure 40d corresponding to the homework by the next time, andthe display controller 30 displays the semantic figures 40a to 40d onthe display 18.

The semantic figures 40a to 40d corresponding to the categories mayrepresent respective summary character strings of the categoriesgenerated by the analyzer 22. In FIG. 4, for instance, the semanticfigure 40a represents the summary character string of the purpose in thetarget data 14, the semantic figure 40b represents the summary characterstring of the problem in the target data 14, the semantic figure 40crepresents the summary character string of the solution in the targetdata 14, and the semantic figure 40d represents the summary characterstring of the homework by the next time in the target data 14.

Alternatively, the semantic figures 40a to 40d corresponding to thecategories may represent respective parts (for instance, priority parts)of the summary character strings of the categories of the target data14.

FIG. 5 illustrates a second display example of multiple semantic figurescorresponding to multiple categories. In the example of FIG. 5, theanalyzer 22 divides the target data 14 into introduction, development,turn, and conclusion, the semantic figure generator 26 generates asemantic figure 40e corresponding to the introduction, a semantic figure40f corresponding to the development, a semantic figure 40gcorresponding to the turn, and a semantic figure 40h corresponding tothe conclusion, and the display controller 30 displays the semanticfigures 40e to 40h on the display 18.

Also, FIG. 6 illustrates a third display example of multiple semanticfigures corresponding to multiple categories. In the example of FIG. 6,the analyzer 22 divides the target data 14 into three categories fromthe viewpoint of three concepts of device, communication, and people,the semantic figure generator 26 generates a semantic figure 40icorresponding to the device, a semantic figure 40j corresponding to thecommunication, and a semantic figure 40k corresponding to the people,and the display controller 30 displays the semantic figures 40i to 40kon the display 18.

The semantic figure 40i represents the target data 14 from the viewpoint(specifically, what type of device appears in the target data 14, andwhat type of role the device has in the target data 14) of device, thesemantic figure 40j represents the target data 14 from the viewpoint ofcommunication, and the semantic figure 40k represents the target data 14from the viewpoint of people.

In this case, based on the meaning of terms represented by thecomponents included in the semantic figures 40i to 40k , a display modeof the components may be determined. For instance, in the category ofpeople, when “Tanaka-san” has more priority than “Saburo-san”, thecomponent indicating “Saburo-san” may be displayed larger than thecomponent indicating “Tanaka-san”. Also, in the same category, apositional relationship for displaying two components representing twoterms may be determined based on the relevance between the two terms.For instance, in the category of communication, when the relevancebetween “Wi-Fi” and “LTE” is high, the component indicating “Wi-Fi” andthe component indicating “LTE” may be displayed at close positions.

As illustrated in FIGS. 4 to 6, multiple semantic figures 40 accordingto multiple categories of the target data 14 may be displayed.Consequently, the same target data 14 can be represented by variousmethods. It is to be noted that as described above, the categories intowhich the target data 14 is divided may be designated by a user.

Also, when multiple semantic figures 40 according to multiple categoriesare displayed, a component indicating the same term may be included indifferent semantic figures 40. For instance, in the example of FIG. 5,although the semantic figure 40e includes the component of the characterof “convenience”, other semantic figures 40f to 40h may also include thecomponent of the character of “convenience”.

As described above, a layout for multiple semantic figures 40 is set bythe layout setting part 28 according to an instruction of a user.

When a semantic figure 40 displayed on the display 18 is selected by auser, the display controller 30 may display an explanation of theselected semantic figure 40. In other words, the display controller 30also functions as an explanation output interface.

For instance, as illustrated in FIG. 7, when multiple semantic figures40a to 40d corresponding to multiple categories of the target data 14are displayed and a semantic figure 40a is selected by a user, thedisplay controller 30 displays an explanation 70 of the semantic figure40a based on the meaning of the target data 14 obtained by the analyzer22. The contents of the explanation 70 show the reason why the semanticfigure 40a is represented in that way. For instance, in the example ofFIG. 7, it can be seen from the explanation 70 that the reason why thesemantic figure 40a includes a graphic indicating “male” is because thename of a character is a male name in the purpose category of the targetdata 14. Also, it can be seen from the explanation 70 that the reasonwhy the semantic figure 40a includes graphics indicating “smartphone”,“cash register”, and “money” is because a topic regarding electronicmoney and a topic regarding advantage of electronic payment were presentin the purpose category of the target data 14. The contents of theexplanation 70 may be generated by the analyzer 22 or the semanticfigure generator 26, and may be all or part of a summary characterstring represented by the semantic figure 40 a.

FIG. 7 is an example in which when multiple semantic figures 40 aredisplayed, the explanation 70 is displayed. However, even when onemeaning figure 40 is displayed as in FIG. 2 or 3, an explanation may bedisplayed when a semantic figure 40 is selected by a user.

Also, when the semantic figure 40 does not represent a summary characterstring and represents part of a character string extracted from thetarget data 14, part of the character string may be displayed as it isas the explanation 70. For instance, in the example of FIG. 2 or 3, whenthe semantic figure 40 is selected by a user, “electronic payment ismade with a smartphone at a convenience store at 17:00” may be displayedas the explanation.

It is to be noted that the explanation may be outputted as voice. Inthis case, a voice output interface (not illustrated) including aloudspeaker of the information processing device 10 functions as theexplanation output interface.

The semantic figure generator 26 may be unable to generate a semanticfigure 40 in a category among the multiple categories of the target data14. For instance, the reason may be because the analyzer 22 is unable togenerate a summary character string in the category or the semanticfigure generator 26 is unable to identify a priority part in thecategory.

When a semantic figure 40 in a category among the multiple categories isnot generated, the display controller 30 displays an error notificationto notify a user of the situation. FIG. 8 illustrates an example oferror notification 72 displayed when a semantic figure 40c correspondingto the solution out of the purpose, problem, solution, and homework bythe next time is not generated.

For instance, when the target data 14 are the minutes of a meeting, thedisplay of the error notification 72 allows a user to easily understandthat discussion on the solution in the meeting is not sufficient. It isto be noted that the contents of the error notification 72 may include areason why a semantic figure 40 has not been generated. For instance, acharacter string such as “discussion on the solution has not beenconducted” or “multiple solutions have been provided, but none of themis a decisive solution” may be displayed as the error notification 72.

As described above, according to the first exemplary embodiment, thesemantic figure generator 26 generates a semantic figure whichrepresents at least part of the target data 14, and the displaycontroller 30 displays the semantic figure 40 on the display 18. A usercan quickly grasp the summary of the target data 14 by checking thedisplayed semantic figure 40, as compared with when a user checks allthe target data 14.

Second Exemplary Embodiment

The schematic configuration of an information processing deviceaccording to a second exemplary embodiment is the same as the schematicconfiguration of the information processing device (the informationprocessing device 10 of FIG. 1) according to the first exemplaryembodiment. Therefore, a description of a portion overlapping with thefirst exemplary embodiment is omitted.

In the second exemplary embodiment, according to the number of times ofappearance, counted by the counter 24, of each of multiple terms whichappear in the target data 14, the display controller 30 displays a termexpression representing each term on the display 18. Here, the termexpression may be a character, a graphic, or a photograph. For instance,the term expression for the term “smartphone” is the character ofsmartphone, a graphic indicating a smartphone, or a photograph of asmartphone.

Specifically, for a term with a greater number of times of appearance inthe target data 14, the display controller 30 displays a term expressioncorresponding to the term in a larger font. In other words, a termexpression corresponding to a term with a less number of times ofappearance in the target data 14 is displayed in a relatively smallfont. Alternatively, a term expression corresponding to a term with agreater number of times of appearance may be displayed in a dark color.In other words, a term expression corresponding to a term with a lessnumber of times of appearance may be displayed in a relatively lightcolor. Alternatively, when a term expression is a character, a termexpression (character) corresponding to a term with a greater number oftimes of appearance may be displayed in a thick font. In other words, aterm expression corresponding to a term with a less number of times ofappearance in the target data 14 may be displayed in a relatively thinfont.

More specifically, the display controller 30 displays a term expressionrepresenting each term at a position according to the meaning of theterm. The concept of displaying a term expression at a positionaccording to the meaning of the term includes two modes.

In a first mode, a term expression of a single term is displayed at aposition according to the meaning of the term. For instance, when theterm is “sky”, “bird”, “head”, or “roof”, the display controller 30displays a corresponding term expression at an upper portion of thedisplay 18. Also, when the term is “sea”, “metro”, “ground”, or “leg”,the display controller 30 displays a corresponding term expression at alower portion of the display 18. Similarly, the display controller 30displays a term expression corresponding to “right hand” or “right leg”at a right portion of the display 18, and displays a term expressioncorresponding to “left hand” or “left leg” at a left portion of thedisplay 18. FIG. 9 illustrates the manner in which term expressions 80are each displayed at a position according to the meaning of acorresponding term.

Alternatively, the display controller 30 may display the term expressioncorresponding to a specific term at a position set by a user. In theexemplary embodiment, for a specific term, a user can set a position atwhich a term expression corresponding to the specific term is displayed.For instance, the display position of a term expression corresponding tothe term “machine” may be set to the center of the display 18.

Also, for each type of term, the display position of a correspondingterm expression may be set by a user. For instance, the displaycontroller 30 displays on the display 18 a screen for setting displaypositions of term expressions as illustrated in FIG. 10. A user inputs atype of term to the setting screen, thereby making it possible to set adisplay position of each term expression according to the type of term.

In the setting screen illustrated in FIG. 10, a user can set the termexpressions corresponding to terms, to be displayed at respectivepositions of the center, the upper right, the lower right, the upperleft, and the lower left of the display 18. In FIG. 10, setting has beenmade so that term expressions corresponding to mechanic-related termsare displayed at the center of the display 18, term expressionscorresponding to nature-related terms are displayed at the upper rightof the display 18, term expressions corresponding to animal-relatedterms are displayed at the lower right of the display 18, termexpressions corresponding to place-related terms are displayed at theupper left of the display 18, and term expressions corresponding totime-related terms are displayed at the lower left of the display 18.

FIG. 11 illustrates a display example in which the term expressions 80are displayed as in the setting illustrated in FIG. 10. When a type ofterm set by a user does not appear in the target data 14, the displaycontroller 30 may display a term expression 80 corresponding to anothertype of term instead of the type of term at a position at which a termexpression 80 corresponding to the type of term originally set by a useris to be displayed. Such another type of term may be determined, forinstance, based on the number of times of appearance in the target data14. In the example of FIG. 11, an animal-related term does not appear inthe target data 14 but a food-related term appears many times, and thusterm expressions 80 corresponding to food-related terms are displayedinstead of animal-related terms at a lower right area of the display 18.

In a second mode, two term expressions corresponding to two terms aredisplayed in a positional relationship according to the relevancebetween the meanings of the two terms. For instance, for two termshaving a higher degree of similarity in the meaning, the displaycontroller 30 displays two term expressions corresponding to the twoterms in greater proximity. In other words, for two terms having a lowerdegree of similarity in the meaning, the display controller 30 displaystwo term expressions corresponding to the two terms apart from eachother. Here, a degree of similarity between two terms can be determinedbased on a thesaurus that is a systematic database in which terms areclassified based on a superordinate/subordinate relationship, apart/whole relationship, a synonymous relationship, and aquasi-synonymous relationship. The “similarity” in the presentdescription is a concept that is applicable to not only terms indicatinga similar meaning (for instance, “PC” and “machine”), but also termshaving a high relevance (for instance, “insect” and “soil”).

When one term is equally similar to other multiple terms, a termexpression corresponding to the one term is displayed between multipleterm expressions corresponding to other multiple terms. For instance,when the term “insect” is similar to both “soil” and “grass”, thedisplay controller 30 displays a term expression corresponding to the“insect” between the term expression corresponding to the “soil” and theterm expression corresponding to the “grass”. Also, for instance, theterm “insect” is similar to any one of “soil”, “grass”, and “grove”, asillustrated in FIG. 12, the display controller 30 displays a termexpression corresponding to the “soil”, a term expression correspondingto the “grass”, and a term expression corresponding to the “grove”around a term expression corresponding to the “insect”.

FIG. 13 is a figure illustrating a display example in which termexpressions 80 corresponding to terms with a similar meaning aredisplayed in proximity. As illustrated in FIG. 13, for instance, theterm expressions 80 corresponding to “nature”, “flower”, “grass”,“tree”, and “water” which are terms having a high degree of similarityare displayed in proximity. Consequently, a term expression group 84 ais formed in which the term expressions 80 corresponding to multipleterms having a similar meaning are in proximity.

It is to be noted that when there are terms in asuperordinate/subordinate concept relationship among the multiple termshaving a similar meaning, the display controller 30 displays a termexpression corresponding to a term in the subordinate concept around aterm expression corresponding to a term in the superordinate concept.For instance, in the term expression group 84 a illustrated in FIG. 13,“nature” is a superordinate concept, and “flower”, “grass”, “tree”, and“water” are each a subordinate concept to the “nature”. In this case,the display controller 30 displays the term expression 80 correspondingto “nature” at the center of the term expression group 84 a, anddisplays the term expressions 80 corresponding to “flower”, “grass”,“tree”, and “water” around the term expression 80 corresponding to the“nature”.

In FIG. 13, in addition to the term expression group 84 a, termexpressions corresponding to “PC”, “machine”, and “mobile phone” whichare terms having a high degree of similarity are displayed in proximity.Consequently, a term expression group 84 b is formed. In this manner,multiple term expression groups 84 a, 84 b may be formed by displayingthe term expressions in proximity, which correspond to terms having ahigh degree of similarity.

The display controller 30 may display the term expressions 80 includedin the term expression group 84 a and the term expressions 80 notincluded in the term expression group 84 a in respective display modesin an identifiable manner. Similarly, the display controller 30 displaythe term expressions 80 included in the term expression group 84 b andthe term expressions 80 not included in the term expression group 84 bin respective display modes in an identifiable manner.

For instance, as illustrated in FIG. 13, a frame 86 a surrounding themultiple term expressions 80 included in the term expression group 84 a,and a frame 86 b surrounding the multiple term expressions 80 includedin the term expression group 84 b may be displayed. Alternatively, thearea in the frame 86 a, the area in the frame 86 b, and other areas maybe colored in different colors. Alternatively, the colors of the termexpressions included in the term expression group 84 a are unified aswell as the colors of the term expressions included in the termexpression group 84 b are unified, then the color of the termexpressions included in the term expression group 84 a, the color of theterm expressions included in the term expression group 84 b, and thecolor of other term expressions 80 may be made different colors.

As described above, according to the second exemplary embodiment, a termexpression corresponding to a term which appears in the target data 14is displayed at a position according to the meaning of the term.Consequently, a user can grasp the meaning of the target data 14 moreeasily, as compared with when a term expression is not displayed at aposition according to the meaning of the term.

Third Exemplary Embodiment

The schematic configuration of an information processing deviceaccording to a third exemplary embodiment is also the same as theschematic configuration of the information processing device (theinformation processing device 10 of FIG. 1) according to the firstexemplary embodiment. Therefore, a description of a portion overlappingwith the first exemplary embodiment is omitted.

In the third exemplary embodiment, the display controller 30 displays animage representing the target data 14 on the display 18. Although asemantic figure 40 (see FIG. 2) generated by the semantic figuregenerator 26 is displayed on the display 18 in the first exemplaryembodiment, the image representing the target data 14 in the thirdexemplary embodiment is not limited to the semantic figure generated bythe semantic figure generator 26. When the target data 14 is a dynamicimage, the image representing the target data 14 may be a still imagecut out from the dynamic image. Alternatively, the image representingthe target data 14 may be an image which is obtained by processing (forinstance, monochrome processing or processing for converting to anillustration style) a still image cut out from the dynamic image.

FIG. 14 illustrates a display example of an image representing thetarget data 14 in the third exemplary embodiment. As illustrated in FIG.14, the display controller 30 can display multiple frames 92 whichinclude respective images 90 representing the target data 14 likecomics. It is to be noted that one image 90 is to be included in oneframe 92 in the exemplary embodiment.

For instance, when target data 14 is a dynamic image, the displaycontroller 30 cuts out multiple still images from the dynamic image, anddisplays multiple frames 92 including the still images as the images 90next to each other so that the multiple still images are arranged in atime series sequence. It is to be noted that the display controller 30may cut out a still image corresponding to a priority part in the targetdata 14 from the dynamic image. As described above, a priority part inthe target data 14 can be identified, for instance, based on a result ofanalysis by the analyzer 22 or a result of count by the counter 24.

It goes without saying that each of the images 90 may be a semanticfigure generated in the first exemplary embodiment. In this case, forinstance, the semantic figure generator 26 generates multiple semanticfigures representing the target data 14, and the display controller 30displays multiple frames 92 including respective generated semanticfigures next to each other so as to represent the meaning of the targetdata 14. When the target data 14 is a dynamic image and each image 90 ofFIG. 14 is a semantic figure, for instance, the first frame is asemantic figure representing the contents of the dynamic image from 0:00to 1:00, and the second frame is a semantic figure representing thecontents of the dynamic image from 1:01 to 2:00.

In the third exemplary embodiment, attention is focused on a featurethat allows a user to set a layout (display) of the images 90 whichrepresent the target data 14. The display controller 30 displays theimages 90 on the display 18 according to the layout set by a user.

The layout setting part 28 sets a layout for the images 90 based on aninstruction of a user. The information processing device 10 receives aninstruction from a user regarding the layout for the images 90 via theinput interface 16. Specifically, the input interface 16 also functionsas a receiving interface. Specifically, as a layout for the images 90,the layout setting part 28 sets, for instance, the number of frames 92on one screen (in other words, the number of images 90 included in onescreen), the number of screens, and the positions, sizes, andarrangement of the frames 92.

A user can set a layout for the images 90 by several methods. Inputmethods for instructing a change of a layout by a user may be any one ofa touch operation, a voice-activated operation, a non-contact gestureoperation, a pointer operation of a mouse, and input of a text command.However, in consideration of the convenience and operational mistake ofa user, the input methods may be switchable by a user setting so thatonly a specific input method is received. For instance, when the noisein the surrounding area is high or there are many people in thesurrounding area, the setting may be changed so that voice input is notreceived, and only a touch operation is received.

As the first method, the display controller 30 displays a layout settingscreen on the display 18 for allowing a user to input a layout, and auser sets a layout by inputting the a layout to the layout settingscreen using the input interface 16.

FIGS. 15A to 15C illustrate examples of a layout setting screen. When auser operates the information processing device 10 to call the layoutsetting screen, a screen as illustrated in FIG. 15A is first displayedon the display 18. The screen illustrated in FIG. 15A is for settingwhether or not the entire target data 14 is summarized. Here, when auser inputs an instruction for summarizing the entire target data 14,the screen illustrated in FIG. 15B is displayed on the display 18.

The screen illustrated in FIG. 15B is for inputting a layout for theimages 90 (that is, the frames 92) which represent the entire targetdata 14. For instance, in the screen illustrated in FIG. 15B, there areprovided a field 100 and a field 102, the field 100 receiving input ofthe number of screens on which the images 90 representing the entiretarget data 14 are displayed, the field 102 receiving input of thenumber of frames per screen. A user can set a layout for the images 90by inputting a desired number to the fields 100 and 102. For instance,when the number of screens is 1 and the number of frames on the 1stscreen is 4, 4 semantic figures representing the entire target data 14is displayed on one screen. Also, when the number of screens is 2 andthe number of frames per screen is 1, 2 semantic figures representingthe entire target data 14 are each displayed on one screen.

Although only the number of screens and the number of frames per screenare settable in the screen of FIG. 15B, the positions, sizes, andarrangement of the frames may be settable on each screen. Alternatively,a value for a setting item such as the number of screens and the numberof frames may be input in a free form, or may be selected from optionssuch as a pull down menu.

In the screen illustrated in FIG. 15A, when a user inputs an instructionfor not summarizing the entire target data 14, the screen illustrated inFIG. 15C is displayed on the display 18.

The display controller 30 can display images 90 for each of thecategories in the meaning of the target data 14. For instance, thedisplay controller 30 can display multiple frames 92 representing thecategories such as the purpose, problem, solution, and homework by thenext time. The layout setting part 28 can set a layout for the images 90for each of the categories in the meaning of the target data 14. Inother words, a layout for multiple frames 92 in each category issettable by a user. It goes without saying that the categories are notlimited to the purpose, problem, solution, and homework by the nexttime, and for instance are described above, the components may bedistinguished by the introduction, development, turn, and conclusion, orthe concepts of device, communication, and people.

The screen illustrated in FIG. 15C is for inputting a layout for theimages 90 (that is, the frames 92) for each of the categories of thetarget data 14. For instance, in the screen illustrated in FIG. 15C,there is provided a field 104 for inputting the number of screens andthe number of frames per screen to represent the categories (thepurpose, problem, solution, and homework by the next time) of the targetdata 14. A user can set a layout for the images 90 in each category byinputting a desired number to the field 104.

As the second method, a layout is set by a user performing an operationon the display 18 on which the images 90 (the frames 92) are displayed.More specifically, when a user inputs an operation as a layout changeinstruction to the display 18, the layout setting part 28 changes thelayout for the images 90 according to the operation. The operations of auser to the display 18 include, for instance, a tap operation, adouble-tap operation, a long-tap operation, a sliding (flick) operation,pinch-in operation, and a pinch-out operation. For instance, when a userperforms an operation on a frame 92, the layout setting part 28 can makea layout change to delete the frame 92 to reduce the number of frames.For instance, when a user performs an operation between two frames 92,the layout setting part 28 can make a layout change to add a new frame92 between the two frames 92 to increase the number of frames. With thesecond method, a user can make layout setting more intuitively than inthe first method. In particular, deletion of a frame 92 at a specificposition and addition of a frame 92 at a specific position are morefacilitated.

FIG. 16 illustrates the manner in which a user performs a slidingoperation on the display 18 on which multiple frames 92 (the images 90)are displayed. When the input interface 16 receives a sliding operationfrom a user, the layout setting part 28 deletes not only a frame 92 alocated at the start point of the sliding operation, but also anotherframe 92 b located in the sliding direction of the sliding operationfrom the frame 92 a, and may make a layout change to reduce the numberof frames by two. Alternatively, in addition to the frames 92 a and 92b, another frame 92 c located on the opposite side to the slidingdirection of the sliding operation from the frame 92 a may be deleted tomake a layout change to reduce the number of frames by three. In theexemplary embodiment, it is assumed that the frames 92 a, 92 b, and 92 care deleted to make a layout change to reduce the number of frames bythree. In this manner, a user can input an instruction for changing thelayout to reduce any multiple frames 92 by a single sliding operation.It is to be noted that a start position may be determined based on along tap to a frame designated by a user.

The display controller 30 displays the frames 92 a, 92 b, and 92 c insuch a mode that while a user is performing a sliding operation, theframes 92 a, 92 b, and 92 c are gradually moved (gradually moved to theright side in the example of FIG. 16) in accordance with the slidingoperation, and when the sliding operation is completed, the frames 92 a,92 b, and 92 c completely disappear from the display 18.

Also, when a user stops the sliding operation during the operation, thelayout setting part 28 does not make a layout change, and the displaycontroller 30 returns the frames 92 a, 92 b, and 92 c, which have movedto midway, to the original positions and displays the frames 92 a, 92 b,and 92 c.

When receiving a sliding operation from a user, the layout setting part28 deletes the frames 92 a, 92 b, and 92 c, and sets a layout of thescreen using the remaining four frames 92. In this case, the layoutsetting part 28 may adjust the positions of the remaining four frames 92as appropriate so that the area in which the frames 92 a, 92 b, and 92 care originally present is not unnaturally vacant. FIG. 17 illustrates adisplay example which is after layout change by a sliding operation andin which the positions of the remaining four frames 92 are adjusted. Thedisplay area of the display 18 in FIG. 17 has some extra space, and theimage size per frame may be increased or decreased to fill up thedisplay area, and the display area may be adjusted to an optimal size asappropriate for display the frames.

When the input interface 16 receives from a user a superpositionoperation for superposing multiple frames 92, the layout setting part 28makes a layout change to merge multiple frames 92 as the target of thesuperposition operation to a single frame 92. In other words, a layoutchange is made in which a single frame 92 is displayed in an area inwhich multiple frames 92 as the target of the superposition operationare displayed.

A superposition operation is a pinch-in operation to pinch multipleframes 92, for instance. Also, the superposition operation may be a dragoperation to superpose one frame 92 on another frame 92 with one finger,an operation to move and superpose multiple frames 92 with fingers ofboth hands, or an operation to input an instruction for superposingmultiple frames 92 via voice input or gesture.

FIG. 18 illustrates the manner in which a user performs a pinch-inoperation on the display 18 on which multiple frames 92 are displayed.When the input interface 16 receives a pinch-in operation from a user,the layout setting part 28 makes a layout change to merge multipleframes 92 as the target of the pinched-in operation to a single frame92. In other words, a layout change is made to display a single frame 92in an area in which multiple frames 92 as the target of the pinched-inoperation are displayed. In this manner, designation of frames for alayout change and designation of a display size after the layout changecan be made at the same time. It goes without saying that only framesfor a layout change may be designated, and a display size may bedesignated separately. When a display size is set so as not to create anarea to merge the frames, after designation of frames is completed, asetting screen for a display size may be displayed, and a display sizemay be received. It is to be noted that multiple images (frame) may be atarget of a pinch-in operation at the same time. Specifically, thiscorresponds to a situation where when a target is identified by thethumb and the index finger of the right hand, a layout change may bemade by designating two frames with the thumb, and three frames with theindex finger. In not only the case where a finger is explicitly incontact with at least part of a frame, but also the case where an area(for instance, an area in the vicinity the frame) is pre-set, contactwith which is considered to be designation to the frame, even when afinger is not in contact with the frame itself, when a finger is incontact with the area the frame may be a target of the pinch-inoperation. In this manner, a user can identify a target by an operationwhich allows easy designation.

For instance, as illustrated in FIG. 18, when a pinch-in operation isperformed, a layout change is made to merge two frames 92 e and frame 92f located at two start points (in other words, the positions of twofingers at the time of start of the pinch-in operation) of the pinch-inoperation to a single frame 92. When another frame 92 is present betweenthe two frames 92 e and frame 92 f located at two start points of thepinch-in operation, the two frames 92 e and frame 92 f, and the anotherframe 92 are merged.

A user can input an instruction for a layout change to merge anymultiple frames 92 by a superposition operation. FIG. 19 illustrates ascreen after the layout change in which the two frames 92 e and frame 92f are merged to be a single frame 92 g. When the size of frame ischanged along with the merging as in FIG. 19, the space for a partitionbetween frames which were present before the layout change iseliminated, and the space may be used for the display area of the mergedframes after the layout change. Although horizontally adjacent framesare merged in this example of merging, vertically adjacent frames ordiagonally adjacent frames may be merged. Also, once merged frame may berepeatedly merged.

While a user is performing a superposition operation (particularly, asuperposition operation with fingers), the display controller 30 movesthe frames 92 e and 92 f (moves the frame 92 e to the right side and theframe 92 f to the left side in the example of FIG. 18) in a direction inwhich both frames approach in accordance with the superpositionoperation. When the superposition operation is completed, the displaycontroller 30 deletes the frames 92 e and 92 f, and displays a new frame92 g.

Also, similarly to the sliding operation, when a user stops thesuperposition operation during the operation, the layout setting part 28does not make a layout change, and the display controller 30 returns theframes 92 e and 92 f, which have moved to midway, to the originalpositions and displays the frames 92 e and 92 f.

Also, when the input interface 16 receives an expansion operation on theframe 92 from a user, the layout setting part 28 may make a layoutchange to expand the size of the frame 92 as the target of the expansionoperation. That is, a user can input an instruction for a layout changeto expand the size of any frame 92 by the expansion operation. In thiscase, the size of the frame 92 as the target of the expansion operationmay be expanded and frames 92 located in the surroundings of the frame92 may be reduced.

The expansion operation is a pinch-out operation to operate multipleframes 92 with spread multiple fingers of one hand, for instance. Also,the expansion operation may be an operation to slide fingers of bothhands in opposite directions, or an operation to input an instructionfor expanding a target frame 92 via voice input or gesture.

Also, when the input interface 16 receives a division operation on aframe 92 from a user, the layout setting part 28 may make a layoutchange to divide the frame 92 as the target of the division operationinto multiple frames 92. That is, a user can input an instruction for alayout change to divide any frame 92 into multiple frames 92 by thedivision operation.

The division operation may include various operations. For instance, thedivision operation may be a pinch-out operation on a target frame 92 asillustrated in FIGS. 20A and 20B. In this case, whether the size of theframe 92 is increased or the frame 92 is divided by a pinch-outoperation may be determined according to an input of a user to a screenfor user check (may be checked via voice) displayed after the pinch-outoperation. Alternatively, whether the size of the frame 92 is increasedor the frame 92 is divided by a pinch-out operation may be pre-set by auser.

For instance, as illustrated in FIG. 20A, when a user performs apinch-out operation on the frame 92 b, as illustrated in FIG. 20B, theframe 92 b is divided into a frame 92 h and a frame 92 i.

The layout for the divided frames 92 may be determined by the startposition of the pinch-out operation and the operational direction of thepinch-out operation. For instance, in the example of FIGS. 20A and 20B,the start position of the pinch-out operation is an approximately thecenter of the frame 92 b, and the operational direction of the pinch-outoperation is from the lower left to the upper right, and so asillustrated in FIG. 12B, the division line of the frame 92 b is in adirection from the upper left to the lower right through the center.

Also, the division operation may be a sliding operation on the frame 92as illustrated in FIGS. 21A and 21B. Also, in this case, whether theframe 92 is deleted or the frame 92 is divided by the sliding operationmay be determined by checking a user or may be pre-set by a user.

For instance, as illustrated in FIG. 21A, when a user performs a slidingoperation on the frame 92 g as illustrated in FIG. 21B, the frame 92 gis divided into a frame 92 j and a frame 92 k.

Alternatively, the layout for the divided frames 92 may be determined bythe path of a sliding operation. For instance, as illustrated in FIG.22A, when the sliding operation is diagonally performed on the frame 92b, the frame 92 b may be diagonally divided along the path of thesliding operation into the frame 92 h and the frame 92 i. Although oneframe 92 is divided in the example of FIGS. 22A and 22B, multiple frames92 may be divided by a single sliding operation by performing thesliding operation along a path through the multiple frames 92.

A case is considered where the images 90 are semantic figures generatedby the semantic figure generator 26. When the layout setting part 28makes a layout change to change the number of semantic figures, thesemantic figure generator 26 regenerates a certain number of semanticfigures after the layout change so that the meaning represented by adifferent number of semantic figures before the layout change isrepresented by the certain number of semantic figures after the layoutchange. The display controller 30 then displays the certain number ofregenerated semantic figures after the layout change.

The semantic figure generator 26 may regenerate semantic figures to bedisplayed after the layout change based on the entire target data 14.For instance, a case is considered where the entire target data 14 isrepresented by 12 semantic figures, and a layout change has been made toreduce the number of semantic figures displayed on the 1st screen bythree in a layout in which 7 semantic figures (that is, 7 frames) aredisplayed on the 1st screen and 5 semantic figures are displayed on the2nd screen. In this case, the semantic figure generator 26 regenerates 9semantic figures so that the meaning of the entire target data 14 isrepresented by the 9 semantic figures, which is the total number of thesemantic figures after the layout change. The display controller 30displays the 9 regenerated semantic figures in the layout after thechange (specifically, 4 semantic figures on the 1st screen, and 5semantic figures on the 2nd screen).

Also, the semantic figure generator 26 may regenerate the semanticfigures to be displayed after the layout change based on the multiplesemantic figures displayed on one screen. For instance, as illustratedin FIG. 16, a case is considered where a layout change has been made toreduce the number of semantic figures displayed on the screen by threein a layout in which 7 semantic figures (that is, 7 frames) aredisplayed on the screen. In this case, the semantic figure generator 26regenerates 4 semantic figures 90a to 90d so that the meaningrepresented by 7 semantic figures displayed on the screen before thelayout change is now represented by 4 semantic figures after the layoutchange. As illustrated in FIG. 17, the display controller 30 thendisplays the 4 regenerated semantic figures 90a to 90d in the changedlayout.

Alternatively, the semantic figure generator 26 may regenerate thesemantic figures to be displayed after the layout change based on thecategories in the meaning of the target data 14. For instance, a case isconsidered where multiple semantic figures are generated for each of thecategories of the target data 14, and the layout for the purpose as oneof the categories is changed from the layout for 7 semantic figuresdisplayed on one screen to the layout for 4 semantic figures displayedon one screen. In this case, the semantic figure generator 26regenerates 4 semantic figures so that the meaning of the purpose of thetarget data 14 is represented by 4 semantic figures after the layoutchange. The display controller 30 then displays the regenerated 4semantic figures as the semantic figures representing the purpose in thechanged layout.

In addition, as illustrated in FIG. 18, when a user performs asuperposition operation on the display 18 on which multiple frames 92(that is, multiple semantic figures) are displayed, the semantic figuregenerator 26 regenerates a new semantic figure 90g so that the meaningrepresented by two semantic figures 90e and 90f as the target of thesuperposition operation is represented by the one semantic figure. Asillustrated in FIG. 19, the display controller 30 may display theregenerated one semantic figure 90g in the changed layout. For instance,when the semantic figure 90e represents the contents of the dynamicimage of the target data 14 from 0:00 to 1:00, and the semantic figure90f represents the contents of the dynamic image from 1:01 to 2:00, thesemantic figure 90g represents the contents of the dynamic image from0:00 to 2:00.

Although each of the exemplary embodiments above has been describedusing an example in which a layout change is made to reduce the numberof semantic figures, it goes without saying that even when a layoutchange is made to increase the number of semantic figures, the semanticfigure generator 26 may regenerate a certain number of semantic figuresafter the layout change so that the meaning represented by a less numberof semantic figures before the layout change is represented by thecertain number of semantic figures after the layout change.

Also, when the layout setting part 28 makes a layout change to changethe number of semantic figures, the semantic figure generator 26 maygenerate a new semantic figure based on the range of the target data 14based on which semantic figures as the target of an instruction for thelayout change are generated. The display controller 30 may display acertain number of regenerated semantic figures after the layout change.

A case is considered where multiple parts of the target data 14, basedon which multiple semantic figures as the target of a superpositionoperation are generated, are not consecutive in time series. Forinstance, in the example of FIG. 18, the semantic figure 90e representsthe contents of the target data 14 from 0:00 to 1:00, the semanticfigure 90f represents the contents of the target data 14 from 5:00 to8:00, and the semantic figure 90e and the semantic figure 90f are thetarget of a superposition operation.

In such a case, the semantic figure generator 26 generates a newsemantic figure that represents multiple parts of the target data 14based on which multiple semantic figures as the target of asuperposition operation are generated, and the display controller 30displays the new semantic figure in the changed layout. For instance, inthe above-described example, one semantic figure 90g is generated anddisplayed, the semantic figure 90g representing the contents of thetarget data 14 from 0:00 to 1:00, based on which the semantic figure 90eis generated, and the contents of the target data 14 from 5:00 to 8:00,based on which the semantic figure 90f is generated.

Also, the semantic figure generator 26 may generate a new semanticfigure that represents a consecutive part including multiple parts ofthe target data 14 based on which multiple semantic figures as thetarget of a superposition operation are generated, and parts locatedbetween the multiple parts in time series in the target data 14. Forinstance, in the above-described example, a semantic figure 90g may begenerated and displayed, the semantic figure 90g representing thecontents of the target data 14 from 0:00 to 8:00, which provide aconsecutive part in time series including the contents of the targetdata 14 from 0:00 to 1:00, based on which the semantic figure 90e isgenerated, and the contents of the target data 14 from 5:00 to 8:00,based on which the semantic figure 90f is generated.

A case is considered where one of the semantic figures is deleted by asliding operation or the like. For instance, in the example of FIG. 16,the semantic figure of the frame 92 c represents the contents of thetarget data from 3:00 to 4:00, the semantic figure of the frame 92 arepresents the contents of the target data from 8:00 to 9:00, thesemantic figure of the frame 92 b represents the contents of the targetdata from 14:00 to 15:00, and the frames 92 a, 92 b, and 92 c are atarget of deletion.

In such a case, the semantic figure generator 26 regenerates thesemantic figures 90a to 90d by adding the contents of the target data 14from 3:00 to 4:00, based on which the semantic figure of the frame 92 cis generated, the contents of the target data 14 from 8:00 to 9:00,based on which the semantic figure of the frame 92 a is generated, andthe contents of the target data 14 from 14:00 to 15:00, based on whichthe semantic figure of the frame 92 b is generated to the target data 14based on which the remaining semantic figures (the semantic figures 90ato 90d of FIG. 17) after the layout change are generated. Also, thesemantic figure generator 26 may regenerate the semantic figures 90a to90d by adding the contents of the target data 14 from 3:00 to 15:00,which provide a consecutive part including the target data 14 based onwhich the semantic figures of the frames 92 a to 92 c are generated tothe target data 14 based on which the remaining semantic figures 90a to90d after the layout change are generated.

A case is considered where a semantic figure is divided into multiplesemantic figures by a division operation. In this case, the semanticfigure generator 26 generates semantic figures of multiple frames afterthe division to indicate the contents represented by the semantic figureof the frame 92 before the division.

When the semantic figure of the frame 92 before the division includesmultiple components and a component is designated by a user and adivision operation is performed on the component, the semantic figuregenerator 26 regenerates a semantic figure representing the contents (ofthe target data 14) indicated by the designated component, and semanticfigures representing the contents indicated by other components, and thedisplay controller 30 may display the regenerated multiple semanticfigures on multiple frames 92 after the division.

For instance, in FIG. 21A, when a user performs a sliding operation onthe frame 92 g of the semantic figure 90g including two components of amale and a smartphone by using the component of the smartphone as astart point (in short, by designating the component of the smartphone),as illustrated in FIG. 21B, a semantic figure 90k is regenerated anddisplayed in the frame 92 k after the division, the semantic figure 90krepresenting the contents indicated by the component of the smartphonedesignated by a user. A semantic figure 90j is regenerated and displayedin the frame 92 j after the division, the semantic figure 90jrepresenting the contents indicated by the component of the male notdesignated by a user.

Here, the sizes of the frames 92 j and 92 k after the division may bedetermined based on the amount of the contents indicated by thecomponent (smartphone) designated by a user, and the amount of thecontents indicated by the component (male) not designated by a user inthe contents represented by the semantic figure 90g of the frame 92 gbefore the division. For instance, in the contents represented by thesemantic figure 90g , when the amount of the contents regarding a maleis three times the amount of the contents regarding a smartphone, thesize of the frame 92 j may be three times the size of the frame 92 k.

Also, when receiving a division operation to designate a division lineof the frame 92 by a sliding operation or a pinch-out operation, thesemantic figure generator 26 may regenerate a semantic figurerepresenting the contents indicated by a component located in one ofareas divided by the division line in the frame 92 before the division,and a semantic figure representing the contents indicated by a componentlocated in the other area, and the display controller 30 may display theregenerated multiple semantic figures on multiple frames 92 after thedivision.

For instance, in FIG. 22A, when a user performs a division operation todesignate a division line on the frame 92 g of the semantic figure 90gincluding two components of Euro and Yen so as to include the componentof Euro in one of areas and the component of Yen in the other area, asillustrated in FIG. 22B, a semantic figure 90h representing the contentsindicated by the component of Yen is regenerated and displayed in theframe 92 h after the division, and a semantic figure 90i representingthe contents indicated by the component of Euro is regenerated anddisplayed in the frame 92 j after the division.

As described above, according to the third exemplary embodiment, a usercan designate a layout for the images 90 which represent the target data14. Therefore, a user can display the images 90 in a desired layout.

Although the exemplary embodiments according to the invention have beendescribed above, the invention is not limited to the above-describedexemplary embodiments, the exemplary embodiments may be combined andutilized, and various modifications may be made without departing fromthe spirit of the invention.

The foregoing description of the exemplary embodiments of the presentinvention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

What is claimed is:
 1. An information processing device comprising: areceiving interface that receives a layout of at least one figure basedon an instruction of a user, the at least one figure representing ameaning of at least part of target data based on a meaning obtained fromthe target data; and a display controller that displays the at least onefigure on a display according to the layout received by the receivinginterface.
 2. The information processing device according to claim 1,wherein the layout includes a number of the at least one figurecontained in one screen on the display.
 3. The information processingdevice according to claim 1, wherein the display controller displays asetting screen for inputting the layout on the display, and thereceiving interface receives the layout by the user inputting the layoutto the setting screen.
 4. The information processing device according toclaim 2, wherein the display controller displays a setting screen forinputting the layout on the display, and the receiving interfacereceives the layout by the user inputting the layout to the settingscreen.
 5. The information processing device according to claim 1,wherein the receiving interface receives the layout by the useroperating the display on which the at least one figure is displayed. 6.The information processing device according to claim 2, wherein thereceiving interface receives the layout by the user operating thedisplay on which the at least one figure is displayed.
 7. Theinformation processing device according to claim 5, wherein when theuser performs a sliding operation on the display, the receivinginterface receives a layout change instruction to delete the at leastone figure located on an imaginary line from a start point of thesliding operation in a sliding direction of the sliding operation. 8.The information processing device according to claim 6, wherein when theuser performs a sliding operation on the display, the receivinginterface receives a layout change instruction to delete the at leastone figure located on an imaginary line from a start point of thesliding operation in a sliding direction of the sliding operation. 9.The information processing device according to claim 5, wherein the atleast one figure includes a plurality of figures, and when the userperforms an operation to superimpose the plurality of figures on oneanother, the receiving interface receives a layout change instruction todisplay one figure in an area where the plurality of figures are to besuperimposed on one another.
 10. The information processing deviceaccording to claim 6, wherein the at least one figure includes aplurality of figures, and when the user performs an operation tosuperimpose the plurality of figures on one another, the receivinginterface receives a layout change instruction to display one figure inan area where the plurality of figures are to be superimposed on oneanother.
 11. The information processing device according to claim 1,wherein the layout is settable for each of categories of meaning in thetarget data.
 12. The information processing device according to claim 2,wherein the layout is settable for each of categories of meaning in thetarget data.
 13. The information processing device according to claim 3,wherein the layout is settable for each of categories of meaning in thetarget data.
 14. The information processing device according to claim 4,wherein the layout is settable for each of categories of meaning in thetarget data.
 15. The information processing device according to claim 5,wherein the layout is settable for each of categories of meaning in thetarget data.
 16. The information processing device according to claim 7,wherein the layout is settable for each of categories of meaning in thetarget data.
 17. The information processing device according to claim 9,wherein the layout is settable for each of categories of meaning in thetarget data.
 18. The information processing device according to claim 1,wherein when the receiving interface receives an instruction to change anumber of the at least one figure, the display controller displaysre-generated figures with the changed number of the re-generatedfigures, the re-generated figures representing meaning represented withthe number of the at least one figure before change.
 19. The informationprocessing device according to claim 18, wherein the display controllerdisplays re-generated new figures based on a range of the target databased on which the new figures are generated by the instruction tochange the number of the at least one figure.
 20. A non-transitorycomputer readable medium storing an information processing programcausing a computer to execute a process, the process comprising:receiving a layout of at least one figure based on an instruction of auser, the at least one figure representing a meaning of at least part oftarget data based on a meaning obtained from the target data; anddisplaying the at least one figure on a display according to the layoutreceived in the receiving.